Elephants can always remember: Exact long-range memory 

effects in a non-Markovian random walk 
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Abstract 

j^ \ We consider a discrete-time random walk where the random increment at time step t depends 

on the full history of the process. We calculate exactly the mean and variance of the position 
and discuss its dependence on the initial condition and on the memory parameter p. At a critical 






C/3 



1^ \ value pc = 1/2 where memory effects vanish there is a transition from a weakly localized regime 

Q ' (where the walker returns to its starting point) to an escape regime. Inside the escape regime 

o : 

there is a second critical value where the random walk becomes super diffusive. The probability 
CN '■ 

^ , distribution is shown to be governed by a non-Markovian Fokker-Planck equation with hopping 

m 

Q^ ' rates that depend both on time and on the starting position of the walk. On large scales the 

vn ■ 

^O ■ memory organizes itself into an effective harmonic oscillator potential for the random walker with 

O , 

^r , a time-dependent spring constant k = {2p — l)/t. The solution of this problem is a Gaussian 



o 



X 



distribution with time-dependent mean and variance which both depend on the initiation of the 
process. 
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Memory effects in non-Markovian stochastic processes are often incorporated heuristically 
on a coarse-grained scale into time evolution equations for physical observables, recently dis- 
cussed in yj, I2I, |3[ . A fundamental concept of a non-_Markovian process is the continuous-time 
random walk introduced already some years ago [^l- This theory has numerous important 
applications, studied for instance in [5| or recently in p. A broad variety of examples in 
biology is analyzed in [7[ . Alternatively, one may derive a formally exact evolution equation 
for an observable by a projection mechanism J8|, |9| and then apply some approximation 
scheme for the solution of the equation. Techniques of this type are used in the context of 
diffusive dynamics where memory effects may lead to anomalous diffusion or even localiza- 
tion. In recent studies this has been demonstrated within an one-loop renormalization group 
, by other analytical studies |11| and confirmed by numerical methods [1^. A 



more fundamental approach to anomalous diffusion based on a nonequilibrium statistical 
description is already discussed in jisf. While very successful both phenomenologically and 
in predicting interesting new memory effects |l^ , two intrinsic shortcomings of these tradi- 
tional approaches deserve attention: There is no quantitative control over the error induced 
by approximations and the microscopic origin of the memory term is frequently obscured. 
In particular, there is usually no simple transition from an explicit and physically motivated 
non-Markovian noise term to an associated non-Markovian evolution equation for the prob- 
ability density which is often employed in the framework described above [l5|- It is the 
aim of this paper to skirt these problems in the investigation of memory effects in diffusive 
motion by first defining a simple "microscopic" non-Markovian stochastic dynamics for the 
random walk on lattice scale, then passing to an evolution equation for the probability dis- 
tribution (in formal analogy to passing to a Fokker-Planck equation (FPE) in the case of 
Markov processes) and finally coarse graining by taking the limit of large space- and time 
scales. As the result we get a FPE with a time-dependent drift term. Recently stochastic 
processes leading to FPE with time-dependent coefficients, are discussed by several authors 
Iall2ll21|. In view of those more heuristic approaches our model yields a more microscopic 
foundation for a special realization of a FPE with a time-dependent term. 
Specifically we are interested in conditions under which an unbounded memory can induce 
qualitative changes in the distribution of the position as compared to the Markovian case 
with Gaussian distribution on large space and time scales. It is well-known from the self- 
avoiding walk (which is a rare example for a random walk with unbounded memory where 



detailed exact results are known 



16l llTJ I) that the memory of the previously visited sites 
changes the scaling behavior of the distribution and leads to a super diffusive mean square 
displacement. Here we investigate how a very different unbounded memory affects the ran- 
dom walk statistics and induces a transition to super diffusive behavior. For definiteness and 
simplicity of notation we mainly consider a one- dimensional random walk X^ G Z on the 
infinite lattice. The random walk starts at some specific point Xq at time to = and has a 
complete memory of its whole history. In allusion to the traditional saying that elephants 
can always remember we shall refer to the random walker as elephant. In each discrete time 
step the elephant moves one step to the right or left respectively (simple random walk), so 
the stochastic evolution equation is given by 

X,+i =Xt + a^+i (1) 

where at+i = ±1 is a random variable. The memory consists of the set of random variables 

at' at previous time steps which the elephant remembers as follows: 

(Dl) At time t + 1 a number t' from the set {1, 2, . . . , t} is chosen randomly with uniform 

probability 1/t. 

(D2) cTi+i is determined stochastically by the rule 

(Tt+i = at' with probability p and = —at' with 1 — p (2) 

At the first time step t = 1 the process is initiated as follows: 

(D3) The elephant starting at Xq moves to the right with probability q and to the left with 

probability 1 — g, i.e., 

0"! = 1 with probabilty q and = — 1 with I — q. (3) 

It is obvious from the definition that 

i 

Xt = Xo + Y,^t'. (4) 

t'=i 

The question is to which extent the memory of the history influences the distribution of the 

particle position. For p < 1/2 the elephant behaves metaphorically speaking like a dedicated 

(but not very stringent) reformer: At each step he is preferentially doing the opposite of 

what he (randomly) remembers to have been decided in the past. For p > 1/2 the elephant 

is a more traditional type, he preferentially sticks to his former decision. Notice that three 



special cases of our model are trivial: (i) In the borderline case p = 1/2 the choice of o"t+i 
is ±1 with equal probability, no matter what the history was. Hence one has the standard 
Markovian random walk which converges to Brownian motion on large scales. In this case 
the initial parameter q plays only a marginal role with no macroscopic significance, (ii) In the 
limiting case p = 1 the dynamics become essentially deterministic. Given the first decision 
(which is random), the elephant moves with probability 1 (ballistically) always one step in 
the same direction as in the first move. Hence the first step is macroscopically relevant, (iii) 
For q = 1/2 the mean position of the elephant is zero for all p. Nevertheless the distribution 
of Xt depends nontrivially on p. 

To study the mean position ( X^ ) we first note that given the previous history {cti, . . . , cTf } 
one has the conditional probability that the increment at+i takes the value cr = ±1 

1 * 
P[at+i = a\ai,...,at] = -^[l + {2p-l)aka] for t>l (5) 

k=l 

This follows from the definitions (Dl), (D2) of the process. For t = we get in accordance 
with rule (D3) 

P\a, = a] = i [1 + (2g - l)a] (6) 



Thus for t > 1 the conditional mean increment is given by 



2p-l 



(cTi+i I (Ti . . . CTi) = ^ (yP[(Jt+l = fT|0-i, . . . , CTt] = {Xt - Xq) (7) 

These relations form the basis of the subsequent analysis of the process. Below we shall 
frequently use the shifted parameters 

a = 2p-l, (3 = 2q-l (8) 

which are in the range [—1,1]. Negative a corresponds to the "reformer", positive a 
parametrizes the "traditionalist" elephant. The effectively memoryless Markovian case is 
a = 0. From ((Tj) the conventional mean value (obtained by summing over all previous 
realizations of the process) is given by 

(^m) = y((X*)-Xo) (9) 

and gives rise to the recursion for the mean displacement {xt) = {Xt) — Xq 

{xt+i)={l + '^){xt)ioit>l. (10) 

4 



For the first time step one has (xi) = (ai) = 2q — 1 = p. The solution of (jTIH) is obtained 
by iteration 

For a < (reformer) the mean displacement vanishes for large t algebraically, the elephant 
stays on average essentially where it started. For a > (traditionalist) the mean displace- 
ment increases indefinitely, albeit with decreasing velocity. The direction of the escape from 
the starting position is determined by the first (random) decision. If the first move is pos- 
itive, the average direction of motion is to the right. Otherwise the elephant moves on 
average to the left. At the transition point ac = the mean displacement is independent 
of time, as is known for the usual Markovian random walk. Recursion relations for higher 
order moments also follow straightforwardly from (jH)). They obey recursions of the form 

Mi+i = ft + gt Mt for t > 1 (12) 

where Mt is some moment and ftiSt are known functions, related to lower moments. The 
general solution of (jT^ is given by 

t-l i-l 



t-1 



fn JJ 9k 

k=n+l 



(13) 



k=l n=l 

which is easily verified. In particular for the second moment of the displacement one finds 
the recursion 



Using (fT^ it is solved by 



(4+i) = 1 + ( 1 + t) <'''> (") 



<^?)-^(n™^-l- (-) 



We first notice that the mean square displacement does not depend on the initial decision 
parametrized by q since (xf) = 1 for any q. Asymptotically one has 

t t'^P-'^ 

i^t) = j^^ P<3/4; (x?)=tlnt p = 3/4; (x^ = ^^^ _ 3)^(4^ - 2) ^ > ^/^ 

(16) 
Before discussing this result we remind the reader that the displacement Xt = Xt — Xq refers 
to the displacement from the initial position, not to the displacement of the actual position 
from its mean. Remarkably there is no qualitative change at Oc = where the transition 



to the escape regime occurs, yet there are two distinct regimes inside the escape regime. 

(1) For a < 1/2 (corresponding to p < 3/4) the mean square displacement increases asymp- 
totically hnearly in time. Hence the localized regime a < ac = corresponds to a weak 
localization in the sense that the initial mean displacement vanishes for large t, but the 
variance increases diffusively with a diffusion coefficient D = 1/(6 — 8p). In the range 
< « < 1/2 (corresponding to 1/2 < p < 3/4) the mean displacement diverges (escape 
regime), but with an exponent a < 1/2. Therefore the mean square displacement is still 
larger than the square of the mean and the variance {xj) — {xt) remains diffusive. 

(2) For a > 1/2 (corresponding top > 3/4) the mean square displacement increases stronger 
than linearly ~ f^^^^ and is of the same order as the square of the mean, but with a different 
prefactor. Hence the variance becomes superdiffusive with an effective diffusion coefficient 
depending both on time and on q. 

(3) At the critical value ac = 1/2 (corresponding to p = 3/4) the r.h.s. of (jT^ reduces to 
X]n=i '^/^ ~ tint. The elephant is marginally superdiffusive. 

The results of the previous section are sufficient for the characterization of the large 

scale walk properties of the elephant only if the increments 0"„ are independent random 

variables, i.e., for a = 0. In this case the central limit theorem guarantees convergence of 

the distribution of Xt to a Gaussian. In order to obtain information about the distribution 

for a 7^ we consider the complex- valued characteristic function Qt{k) = { e*^^' ). Using (0) 

it obeys the equation 

(y d 

(Qt+iik)) = coskQtik) +smk—Qt{k). (17) 

t dk 

The Fourier transform Pt{x) is the probability that the displacement at time t takes the 
value X. This is equal to the conditional probability P{Y, t|Xo, 0) that the position X of the 
elephant at time t equals Y = Xq + x, given that it started at Xq at t = 0. From ()17|) we 
find a discrete evolution equation formally analogous to the Fokker Planck equation (FPE) 
for usual random walks 

p(y,t + i|Xo,o) = J[i-^(r-Xo + i)]p(r + i,t|Xo,o) 



2 

1 

+ 2 



l + -(F-Xo-l) P(F-l,t|Xo,0). (18) 



t 

This equation (valid for t > 1) may be interpreted in terms of a time-inhomogeneous random 
walk which does not memorize its full history, but only its initial position at time t = 0. It 



describes a hopping process where in each step the walker at position Y hops to the right with 
probabihtyp^ = (l+a(F-Xo)/t)/2 and to the left with probabihtyp/ = {l-a{Y-Xo)/t)/2 
respectively. At first sight these stochastic dynamics look like a time-inhomogeneous Markov 
chain where Xq is some parameter. However, we stress that in (jl8|) the quantity Xq is not 
a parameter, but the initial position of the elephant. The hopping probabilities implicit in 
fll8|) are not valid for an elephant starting at a position different from Xq or which starts 
at Xq at a later time t > 0. The non-Markovian character of the dynamics is expressed in 
the fact that the evolution equation (fTHj) is different for each initial position, see [15| for a 
general discussion of similar non-Markovian evolution equations. The qualitative features of 
the elephant which became apparent through the study of its mean position are expressed 
in the hopping probabilities Prj- For positive a the local bias 

b{x, t) =pr~pi = — (19) 

is positive for positive displacement, hence the particle on average escapes. On the other 
hand, for negative a, the bias is opposite to the actual displacement, reminiscent of some 
effective restoring force. This becomes very transparent in the continuum limit (large dis- 
placement X and time t) . In terms of x, t (I18|) takes the form 

of a FPE for a Brownian particle in a harmonic oscillator potential with spring constant 
k = a/t. The last relation is a special case of more general FPE with time-dependent 



coefficients that has been investigated in several papers [18|, |19|, |20| . Whereas the approach 
in those papers is phenomenologically we demonstrate in the frame of a microscopic model 
the origin of such FPE. From Eq. ()20|) one obtains recursion relations for the moments of 
the distribution. Let us denote the even and the odd moments by 

a„(t) = (a;^'^) 6„(t) = (x^^+i ) with n = 0, 1, 2, . . . (21) 

Using Eq. (j2Up we obtain for the even moments 

-anit) - —^an{t) = n{2n - l)a„_i(t) (22) 

and a similar equation for the odd moments. In particular, we have 



|(.> = f (.) (23) 



with the solution 



{x{t)) = {x{to)) [ — ] = x{t) with t > to > 



(24) 



in agreement with PHI . Here to is temporal cut-off scale, reffecting the break;down of the 
continuum approximation for t — ;> 0. For second moment we find 



{x^) = A{t) + x\t) 



(25) 



with x{t) given by (j^ and 



2« 



A(t)=(^) [{x\to))-x\to)]+^^ 



2a- 1 



1 



(26) 



Since the initial distribution is assumed to be concentrated at xq the initial variance and so 
the first term in ()26|) vanishes. Thus we can read off the effective diffusion coefficient 

2a-l 



Dit) 



1 



4a -2 



1 



(27) 



of the elephant. In ()22|1 one recognizes the recursion relations for the moments of a Gaussian 
distribution. Indeed, one can straightforwardly verify that 

1 / {x-x{t)f^ 



P{x,t) 



exp 



(28) 



/4ntD{t) ' V 4tD(t) 

solves the evolution equation (fT7|) for the initial condition 6{Y — Xq) = 6{x — x(to))- The 
centered even moments 



M2n = {{x- x{t)f^ ) = {2n- l)\\{2tD{t)y 



(29) 



which satisfy the recursion relation ()22|1 are given by the usual expression for a Gaussian 

distribution. 

The result can be generalized to the d-dimensional case with a separate memory for each 

space direction. To this aim the rules (Dl)- (D3) are generalized accordingly. Eq. Q 

is changed to an equation for a d-dimensional vector and correspondingly the conditional 

probability (fTHj) depends also on the d-dimensional position vector. In the continuous limit 

the evolution equation reads 



dP{x, t) 1 



a. 



dt 



^V'P{x,t)-jV{xP{x,t)). 



(30) 



Based on that evolution equation we find also the equations for the even and odd moments. 
In particular the even moment an{t] d) =< (a;^)" > satisfies instead of Eq. (|^^ the equation 

— a„(t; d) —an{t] d) = n[d + 2{n - l)]a„_i(t; d) (31) 

A solution of this equation which yields the even centered moments is 

r(- + n) 
a^{t-d) = ^^^{2tD{t)r (32) 

The odd moments 6^(t; d) =< {x^)"'Xp > obey the equation 

j/nit; d)) - ^^^^^&^(t; d)) = n{2n + rf)6^,(t; d)) (33) 

for the odd moments of a d-dimensional Gaussian distribution. 

Starting with a "microscopic" model of a random walk with unbounded long-time 
memory (the "elephant") we have calculated the exact mean and variance respectively as 
well as the single-time probability distribution for the position of the elephant on large 
scales. Surprisingly the memory effects incorporated in the probability distribution at time 
t amount to a time-inhomogeneous random walk where only the initial position and starting 
time play a role. 



Note added: After submission of this paper, work on a similar model was published by S. 
Hod and U. Keshet, Phys. Rev. E 70, 015104(R) (2004). 
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